This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
Please do not report the images to the 
Image Problem Mailbox. 
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+ 



202- 



Generate pseudorandom 
sequence of 8-bit integers 



204- 



I 



Encrypt 8-bit sequence to form 
Secure Sequence of 8-bit integers 



206- 



I 



Select abutted pairs from Secure 
Sequence to form 16-bit integers 
(e.g., 51 2 2 samples) 



208- 



Linearly remap 16-bit samples 
and form 1>-w(ij)> (1-2JJ) 



210- 



212- 



I 



Compute discrete Fourier transform of 
w(|a,v) to form W(a,x) 



MI 



Expand (a, t) frequency coordinates 
by zero-padding to form (s,t) coordinates 



214- 



r 216b - s 



Compute Watermarking plane, w(m,n), 
as inverse Fourier transform of W(s,t) 



Hardclip elements of w(m,n) to 
have values of i ( or 1-2p 
and median of 1-fi 



* r 



216a 



Adjust elements- of w(m,n) to 
have a mean and median of 1-p 
and a maximum of 1 
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304 



302- 



Expand watermarking plane by tiling 
to cover Unmarked Image 



I 



Modify magnitudes of each pixel component 
in the Unmarked Image multiplying it 
by the corresponding element in the 
Watermarking Plane 



C End,) ,; 
? Fig. 3 
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402- 
404- 

i ■ 

MA. 



406- 



Regenerate an exact copy of 
"the Watermarking Plane from 
its four known parameters 



I 



Rotate and resize Marked 
Image to its known ; ^ - 
original dimensions 



Align rotated and resized 
Marked Image with the expanded 
regenerated Watermarking Plane 



■JL 



Fig. 4 
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502- 



Display Marked Image and Correlation 
Reference Plane on a common display 



504 



> 506- 



508- 



I 



Overlay Marked Image with 
Correlation Reference Plane 
, by manual manipulation 

i 



> Store values of vertical; horizontal and 
angular offsets and magnification/reduction 
factors required for manual alignment 



I 



Reduce/enlarge, translate and rotate 
the Marked Image by reciprocals of stored 
values to make ready for fine alignment 



Q End ^) -t .u: ■:■■->■■ 



Fig. 5 
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602 
604- 
606- 



Compute U(s,t) as discrete Fourier 
transform of the Marked Image u(m,n) 



Set initial values Vm -Hm =0.96 Ar = -5* 



Vertically magnify/reduce Correlation 
Reference Plane c(m,n) by factor Vm 



608 
609 



Horizontally magnify/reduce above adjusted 
Correlation Reference Plane by factor Hm 



Rotate above adjusted Correlation Reference Plane by angle Ar 



610- 
611 



Compute W($,t) as discrete Fourier transform 
of adjusted Correlation Reference Plane 



Compute Phase Correlation Plane p(m,n) 



612- 



I 



Locate t he maximum peak at coordinate s (m*,n*) 



613 



614 
Yes 



Store p(7r?*,/j*) at coordinates 
(Vm,Hm,Ar) of 
3-D Interpolation Array 



616 



Yes 



^1 



No 



615 , 



Ar=Ar+2' 



617 



618 



-< $im=1.0$ > ^° — | \Hm&Hm^.02,Ar~-5 



:<3 



Yes 



No 



620- 



1^ 



Wr)=Wn+0.02, Hm=0.96, Ar=-5° 



Interpolate to find maximum of maxima p(m*,n*) 



619 



Reduce/enlarge, rotate and offset Marked Image with reciprocals; 
of coordinates (Vm,Hm,Ar) of maximum of maxima 



622 



(End) 



F5' 



'4J(Q@-(S 
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702 



Choose rectangular Selector and Visualizer 
arrays of equal size, (e.g., 32x128) 



704 



I 



Set Selector's Coincidence and Non- 
Coincidence Counters to zeros 



706- 



T 



Initially place Selector on the Marked Image and 
Watermarking Plane, aligning upper-left, comers 



708 



I 



Choose next two 8-bit integers from Secure Random Sequence 



,710 



I 



Scale the two integers to form random horizontal and vertical % 
offsets from present Selector location and move the Selector there 



711 



Reset Selector element sequence and choose the first element 



712 



713- 



Use coordinates of Selector element to locate 
a corresponding, element in the Watermarking Plane 



Compute average of neighboring elements in the 
Watermarking Plane, (e.g., 120 neighbors). 



714 



Choose the next (or only) color 
plane of the marked Image/";., 



715 



J 



Use coordinates of Selector element to locate a 
corresponding pixel -in the chosen Color Plane 



716 



_i 



Compute average of neighboring pixel color elements 
in the chosen Color Plane, (e.g., 130 neighbors) 
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Are both the selected 
Wartermarking Plane element 
and Color Plane pixel element 
equal to or greater than their 
neighborhood averages? 





Are both the selected 
Watermarking Plane element 
and Color Plane pixel element 
less than their neighbor- 
hood averages? 



718 




increment Coincidence 
Counter of Selector's 
Element 



Increment Non-Coincidence 
Counter of Selector's 
Element 



720 





71% 



Have all 
Color Planes been; 
chosen? 



Wo 





Have all 
Selector elements ; 
chosen? 



No 



( End) 



Choose next 
Selector 
Element 



Have all non- 
bveirtaipping positions of the \ Mo ^, 
Selector on the Marked 
Image been chosen? 



726 



r-729 

Choose next [ 

Selector 

Position 
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1002 



1004- 



Create a Visualizer pattern equal 
in size to the Selector 



I 



Reset Selector element sequence 
and choose first element 



1006- 



I 



For chosen Selector element, form 
difference of its Coincidence count 
less its Non-Coincidence count 



1008 



1010a 




Is this sign of ;f\_N[o_ 



difference positive' 



Move corresponding pixel 
of Visualizer to 
corresponding pixel of 
Visualizer-Coincidence 
Image - 



I 



1 



1010b- 



Mdve inverted corresponing 
pixel of Visualizer Image 
to corresponding pixel of 
Visualizer-Coincidence 
Image 



1012 





1 



Have all Selector 
elements been used? 



No 




Choose next 
element 



1016- 



■ft 



1014 



1020a 




Display Visualizer- 
C oincidence Image 

-.isi.,-.. 

Is the Visualizer 
Image pattern recognizable 



No 



Watermark presence 
positively verified 



*.9 




1020b 



Watermark is 
not detected 




F8g)o W 



11/19 
Braudaway et al. 
LP.H. YOR01 99601 53US4 



12/19 
Braudaway et al. 
L.P.H. YOR019960153US4 



15/19 
Braudaway et al. 
L.P.H. YOR01 99601 53US4 



# 



1502 



1504- 



Create a Visualizer pattern equal 
in size to the Selector 



I 



Reset Selector element sequence 
and choose first element 



1506- 



For chosen Selector element form the ratio 
of its Coincidence count to sum its Coincidence 
and Non-Coincidence counts 




1510a 



Islhe corresponding pixel 
of the Visualizer Image blacks 



Place (1 -ratio) into 
corresponding pixel of 
Visualizer- 
Coincidence Image 




-1510b 



Place ratio into 
corresponding pixel of 
Visualizer- 
Coincidence Image 



1512 




3£ 



Have all Selector 
elements been used?. 



No 




Choose next 
element 



1516- 



1 



Display Visualizer- 
Coincidence Image 



1520a 




I 



1514 



Is the Visualizer \ No 
Image pattern recognizable^ 



1520b 



Watermark presence 
positively verified 



Watermark is 
not detected 




Fig, Hi 
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Fig. 17 
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Fig. 19 




Fig. 20 




Fig. 21 



